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PURPOSE: To embody a device 
which can conduct an interaction 
between each person whose language 
is different from each other and 
between a person and a machine 
without making an interpreter of sign 
language, etc., always reside, so that 
it is not suspended by an erroneous 
translation or a misunderstanding, 
and does not come to a standstill. 




CONSTITUTION: An interactive 
information management part 18 
records an interactive career of a 
sound listener and an auditory sense 
handicapped person. When a 
standstill is generated in an 
interaction between the sound listener 
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and the auditory sense handicapped 
person, it is switched to a 
conversational form executed through 
a sign language interpreter by a 
mutual agreement of both of them. A 
communication management system 
19 can allow the sign language 
interpreter to access the career of the 
interactive information management 
part 18, and also, switches ports 11, 
12 and 13 to such a form as a 
conversation by three persons can be 
executed, based on an instruction of 
the sign language interpreter. 
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* NOTICES * 
JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may 
not reflect the original precisely. 

2. **** shows the word which can not be translated. 

3. In the drawings, any words are not translated. 
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Epitome 



(57) [Abstract] 

[Objects of the Invention] the dialogue between the men, men, and 
machines with which language differs is interrupted by a mistranslation 
or misunderstanding, without translators, such as sign language, 
residing permanently ~ having — line flaw **** — it aims at realizing 
the equipment which can be advanced without things. 
[Elements of the Invention] The dialogue Research and Data Processing 
Department 18 records the dialogue career of an auditory normal person 
and a hearing-impaired person. When a deadlock arises in the dialogue 
between an auditory normal person and a hearing-impaired person, it 
changes to the conversational mode voice through a sign-language 
interpreting person by both agreement. A message control system 19 
enables access of the career of the dialogue Research and Data 
Processing Department 18 at a sign-language interpreting person, and 
also changes ports 11, 12, and 13 to the gestalt in which the 
conversation by three persons is possible based on directions of a sign- 
language interpreting person. 
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CLAIMS 



[Claim(s)] 

[Claim 1] A means to receive the input by the sign language from a 
hearing-impaired person characterized by providing the following, A 
means to recognize and understand the received sign language, and a 
means to translate the result recognized and understood into the 
language which either [ at least ] a dialogue partner or information 
retrieval equipment can understand, A means to transmit a translation 
result to either [ at least ] a dialogue partner or information 
retrieval equipment, Conversely, a means to receive the input from 
either [ at least ] a dialogue partner or information retrieval 
equipment, A means to recognize and understand the received sign 
language, and a means to translate the result recognized and understood 
into the language which a hearing-impaired person can understand, The 
dialogue of a means to be a dialogue control unit in the sign language 
which was equipped with a means to transmit a translation result to a 
hearing-impaired person, and considered sign language as the input, and 
to record the career of a dialogue, a hearing-impaired person, a 
dialogue partner or a hearing-impaired person, and information retrieval 
equipment The means changed to the gestalt of the conversation by two 
persons or three persons through a sign-language interpreting person 
when both dialogue is stuck A means to show a sign-language interpreting 
person the dialogue career by which record was carried out [ above- 
mentioned ] in the conversational mode voice through a sign-language 
interpreting person 

[Claim 2] A dialogue career record means is a dialogue control unit in 
the sign language dialogue according to claim 1 characterized by 
recording at least one information among how far an alphabetic character 
input, an input sign language image, input voice, the recognition result 
of these inputs, the hearing-impaired person, and the dialogue partner 
understand the dialogue. 

[Claim 3] The dialogue control unit in the sign language dialogue 



according to claim 1 characterized by shifting to the conversational 
mode voice which minded the sign-language interpreting person when 
agreement of both who are having a dialog by having a means to tell a 
dialogue partner about the demand of the shift to the conversational 
mode voice through a sign-language interpreting person, and the means 
which refuses the demand was materialized, 

[Claim 4] The dialogue control unit in the sign language dialogue 
according to claim 1 characterized by having a means to receive the 
input from a sign-language interpreting person, a means to transmit the 
input to a dialogue person, and a means to transmit the input from both 
the dialogue person to a sign-language interpreting person, in the 
conversational mode voice through a sign-language interpreting person. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the configuration of the sign-language 
interpreting equipment of one example of this invention. 
[Drawing 2] It is drawing showing the information inquiry structure of a 
system of one example of this invention. 

[Drawing 3] It is drawing showing the example of a display of the 
translation result in the auditory normal person side edge end of sign- 
language interpreting equipment. 

[Drawing 4] It is drawing showing the example of a display of the 
translation result in the hearing-impaired person side edge end of sign- 
language interpreting equipment. 

[Drawing 5] It is drawing showing the example of a display of the 



translation result in the sign-language interpreting person side edge 
end of sign-language interpreting equipment. 

[Drawing 6] It is drawing showing the example of the key for opting for 
the shift to the dialogue which mixed the sign-language interpreting 
person. 

[Drawing 7] It is drawing showing the procedure of an information 
inquiry system. 
[Description of Notations] 

1, 5, 10 [ ~ 6 A touch panel 8 / ~ A telephone, 11, 12, 13 / — 14 A 
port 16 / ~ Recognition the understanding section, 15, 17 translation 
sections, 18 / ~ The dialogue Research and Data Processing Department 
19 / ~ A message control system, 20 / ~ Information inquiry system. ] 
~ A camera, 2 ~ The sensor for an input of operation, 3, 7, 9 ~ A 
terminal, 4 
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